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[57] ABSTRACT 

In accordance with the present invention, the R.G.B 
color image signals from a single sensor having a color 
filter array are all transformed to T-space by changing 
them to R I/T , G t/r , Bi/T, respectively, where T is 
approximately 2.4. In this space, all operations such as 
color differencing, interpolation of those missing pixels 
required for color differencing, compression, decom- 
pression, edge enhancement and final interpolation of 
all missing pixels are performed without further trans- 
formation of the image signals. For the same final bit 
rate, noise in the reproduced image is reduced by re- 
fraining from interpolating the missing color pixels 
prior to compression of the image data. In order to 
avoid over-emphasizing features of the image which are 
already sufficiently sharp, the combined outputs of hori- 
zontal and vertical sharpening processes are subjected 
to a paring process of the invention which suppresses 
strong high-spatial frequency components as a function 
of their amplitude. In the compression-decompression 
process of the invention, each spatial frequency coeffici- 
ent of the spatial frequency-transformed image is di- 
vided by a normalization factor determined by cascad- 
ing in the spatial frequency domain the human visual 
system contrast sensitivity function, the edge enhance- 
ment modulation transfer function and the image dis- 
play modulation transfer function and in versing the 
resulting matrix elements. 

62 Claims, 13 Drawing Sheets 
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are well-known and need not be described herein. One 
IMAGE COMPRESSION WITH COLOR advantage is that this feature permits interpolation of 

INTERPOLATION FOR A SINGLE SENSOR color difference signals rather than ratios, since, for 

IMAGE SYSTEM example, 

5. 

BACKGROUND OF THE INVENTION log K/G=log K-Iog G 

1. Technical Field Md 
The field of the invention is compression of a color 

* image signal —such as that generated by a single sensor i og b/g=\o$ 5- log a 
3-color filter array— whose chrominance-related (e.g., ^ 

blue and red) components are sub-sampled with respect All of the foregoing color image signal processing 

to its luminance-related (e.g., green) component. methods are described in U.S. patent application Ser. 

2. Background Art No . 334,353 fu e d 24 Jul. 1989 by Yusheng T. Tsai, 
Electronic color cameras which employ only a single Kenneth A. Parulslci and Majid Rabbani entitled "A 

sensor are highly economical compared with electronic 15 COMPRESSION METHOD AND APPARATUS 

color cameras employing three separate sensors (e.g., FOR SINGLE SENSOR COLOR IMAGING SYS- 

red, green and blue sensors). A single image sensor TEMS" and assigned to the assignee of the present 

(such as a CCD imager integrated circuit) can be made invention. The referenced application describes how to 

to produce a color image signal simply by imposing a e lo such mcthods m an image compression system, 

color filter array over, the sensor. The color mterarray * In thc referenced patent application, compression prior 

permits light of different colors to impinge on different t0 mtcr polation of thc missing pixels is disclosed. In the 

picture elements (pixels) of the sensor in a fixed prede- ^ compression systen)t the by wh ich digital 

termined pattern. Typically one of the three colors ^ rep resenting each spatial frequency component of 

(usually green) is most close y related to the luminance ^ ^ s{ ^ i$ is H varicd s0 ^ ^ 

^V^ott^m^ wh»lethe remaining two colors 25 for the contrast sensitivity function of the 

(usually red and blue) are most closely related to the £ man ^ dcscribcd ^ vs p J No 4ml6{ 
chrommance components of the image. Using a single <^o j ^ ^ d . d ^ . f ^ 
sensor necessarily reduces the resolution of each color * w u« vi 

component of the image, because sensor pixels dedi- ^ „ . * t : - . . . A . A . . 

cated to one color are m effect "missing- with respect 30 ™ e « recn W*. 13 Preferably interpo ated linearly 
to the other colors. Such "missing" pixels for a given because the green signal is the one most closely related 
color must therefore be inferred by interpolation in the *° the lummance component One problem with he 
reproduced image. Such interpolation can introduce foregoing techniques is that the red, green and blue 
into the reproduced image distortion objectionably must transformed .to loganthms m order to 

visible to the human eye. The human eye is most sensi- 35 best interpolate the color difference signals. This ulti- 
tive to the luminance component of such distortion. mate,v re( l uires a multiplicity of such transformations, 

In order to minimize the perception of such distortion representing a significant processing burden, 
by the human eye and provide the most pleasing repro- Another problem is that image processing, such as 
duced image, the resolution (or pixel density) of the sharpening or edge enhancement, can increase the visi- 
luminance-related (e.g. ( green) pixels is increased at the 40 bility of distortions introduced into the reproduced 
expense of the chrominance-related (e.g., red and blue) image by the compression-decompression process. A 
pixels. Specifically, the color pattern of the color filter related problem is that the modulation transfer function 
array is such that a majority of the sensor pixels receive introduced by the image display (such as a color video 
the luminance-related (green) component of the light, monitor or color paper printing) can affect the visibility 
while the remaining pixels receive the chrominance- 45 of distortions introduced into the image by the compres- 
related colors (e.g., red and blue). For example, a well- sion-decompression process. 

known color filter array (referred to as a 3G color filler Still another problem is that the human eye contrast 
array) consists of three rows of green pixels followed by sensitivity function has a lower frequency response to 
a row of alternating red and blue pixels, so that J of the the color difference signals than to the luminance- 
pixels are green and the blue and red pixels each com- 50 related green signal. While the prior art teaches sub- 
prise \ of the pixels. sampling color pixels with respect to luminance pixels 
In reproducing a color image from the signal gener- to accommodate for this aspect of the human visual 
ated by the image sensor and color filter array combina- system, a better method is needed. This is particularly 

* tion and computing the missing chrominance-related true in the case of the 3G color filter array, in which 
pixels, the distortion perceived by the human eye is 55 sub-sampling of the red and blue pixels is non-isotropic, 
further reduced by interpolating between the ratios of being two times greater along the columns of the array 
the chrominance-related (red and blue) pixels to the than along the rows of the array. 

co-located green pixels. This approach succeeds in re- Yet another problem is that such edge enhancement 
ducing the distortion detected by the human eye be- processes tend to objectionably over-emphasize image 
cause it can be shown that it reduces the luminance 60 features which are already sufficiently sharp. It has 
component of the distortion (without necessarily reduc- seemed that this is an unavoidable penalty which ac- 
ing the overall distortion). companies edge enhancement of the image. Therefore, 

A further improvement is achieved by performing there is a need for an edge enhancement process which 
such color interpolation of intensity values using the does not over-emphasize sufficiently sharp image fea- 
logarithm of each pixel intensity rather than the pixel 65 turcs. A related problem is that a CCD image sensor 
intensity itself. This feature improves the color fidelity introduces CCD charge transfer noise into its output 
in the reproduced image because of the non-linear rela- signal in a non-isotropic manner which affects high 
tionships involved in combining color signals, which spatial frequency texture or edge features lying along 
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one axis of the image more than those lying along the for recording, storage or transmission and is later de- 
other axis of the image. Edge enhancement tends to compressed before the missing pixels are inferred by 
emphasize such noise. interpolation. 

Accordingly, it is an object of the invention to repro- In the edge enhancement or image sharpening pro- 
duce an image from a single sensor/color filter array 5 cess of the invention, the T-space luminance-related 
combination without requiring any logarithmic trans- signal (the green signal in the case of an RGB color 
formations whatsoever. signal) is sharpened by emphasizing high-spatial fre- 
It is a further object of the invention to perform all quency image components along the vertical and hori- 
processing and compression of all components of the zontal axes independently without transforming the 
image signal in the same color space, thereby minimiz- 10 signal to another space. In order to avoid over-empha- 
, ing the number of required transformations. sizing high-spatial frequency image components which 
It is another object of the invention to automatically are unreliable or noisy due to the non-isotropic manner 
compensate for the effects of the edge enhancement in which CCD transfer noise is introduced into the 
process and of the image display on the visibility of sensor output signal, a transversal blur or low-pass filter 
errors introduced by the compression/decompression 15 is imposed on the output of the vertical axis sharpening 
image process. process before it is combined with the output of the 
It is still another object of the invention to provide horizontal axis sharpening process. In order to avoid 
different adaptive corrections in the compression- over-sharpening features of the image which are al- 
decompression processes for different (luminance- ready sufficiently sharp, the combined outputs of the 
related and chrominance-related) components of the 20 horizontal and vertical sharpening processes are sub- 
image best suited for the respective components. jected to a paring process of the invention which sup- 
It is a still further object of the invention to provide presses strong high spatial frequency components as a 
different adaptive corrections in the compression- function of their amplitude. 

decompression processes for different components of The invention compensates for the effects of the mod- 
the image in accordance with the lower frequency re- 25 ulation transfer function of the edge enhancement pro- 
sponse of the human visual system to the color differ- cess and the color image display device or media on the 
cnce signals and in accordance with the non-isotropic visibility of distortions introduced by the data compres- 
pattern of the green, red and blue pixels of the color sion process. This compensation is achieved in the data 
filter array. compression process, which requires that the image 
It is yet another object of the invention to provide an 30 data be divided into blocks and each block be trans- 
edge enhancement process which does not over-empha- formed to a block of spatial frequency coefficients. In 
size image features which are already sufficiently sharp accordance with the invention, the bit resolution of 
and which does not require any transformation of the each spatial frequency coefficient is determined by di- 
image data to another color space (e.g., a log or anti-log viding the coefficient by a corresponding normalization 
transformation). It is a related object of the invention to 35 factor taken from an array of normalization factors. The 
provide such an edge enhancement process which re- array of normalization factors is determined by (in ef- 
frains from emphasizing CCD transfer noise affecting feet) cascading in the spatial frequency domain the 
high spatial frequency image features along one axis human visual system contrast sensitivity function, an 
without detracting from the edge enhancement of fea- edge enhancement modulation transfer function and an 
tures lying along the other axis of the image. 40 image display modulation transfer function and invers- 

DISCLOSURE OF THE INVENTION mg eac ^ element in the resulting cascaded transfer func- 
tion to its reciprocal. 

In accordance with the present invention, the color Preferably, the human visual contrast sensitivity 

pixel amplitudes from a single sensor having a color function, the edge enhancement modulation transfer 

filter array are all transformed to T-space by raising 45 function and the display modulation transfer function 

them to the power of 1/T, respectively, where T is each comprise an array of spatial frequency domain 

approximately 2.4. For example, if the color filter array amplitude elements corresponding to a block of spatial 

provides red, green and blue (R,G,B) color pixel ampli- frequency coefficients of the image data. The arrays 

tudes, then the transformation provides the following . thus formed are then cascaded. This is accomplished in 

T-space color signals: R 1/r , G 1/T , B 1/r . All operations 50 a progressive manner by first determining from the 

such as color differencing, interpolation of those miss- parameters of position-to-spatial frequency transforma- 

ing pixels required for color differencing, compres- tion the number of cycles per block of each spatial 

sion/decompression, edge enhancement and final inter- frequency coefficient in the block. Next, the number of 

polation of all missing pixels are performed in T-space cycles per pixel is determined from the number of pixels 

without further transformation of the image signals. 55 per block for each spatial frequency coefficient in the 

(This transformation has been used in other applications block. This information is used to construct a corre- 

to achieve more faithful reproduction and less visible spending array representing the edge enhancement 

quantization noise in comparison with other methods modulation transfer function. Next, the number of cy- 

which used the logarithm of the luminance, as described cles per unit distance is determined from the pixel spac- 

in "Uniform Perceptual Quantization: Applications to 60 ing of the display for each spatial frequency coefficient 

Digital Radiography" by Sezan, Yip and Daly, IEEE in the block. This information is used to construct a 

Trans. Sys. Man. Cyber. Vol. SNC-17 #4 1987 622-634.) corresponding array representing the image display or 

The advantage realized in the present invention is the media modulation transfer function. Finally, the num- 

elimination of unnecessary transformation steps, so that ber of cycles per degree of visual scan is determined 

the entire signal process is greatly simplified by per- 65 from the viewing distance characteristic of the display 

forming every step in T-space and sources of error are for each spatial frequency coefficient in the block. This 

reduced. In the preferred embodiment of the invention, information is used in the manner described in the 

the uninterpolated T-space image data is compressed above-referenced U.S. Pat. No. 4,780,761 to Scott J. 
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Daly et al. to construct a corresponding array (i.e. cas- FIGS. 14a and 14* illustrate, respectively, the nor- 
cade) representing the human visual contrast sensitivity malization factor array obtained from the cascaded 
function. These three arrays are then multiplied to- array of FIG. 13d and a normalization array obtained 
gether as a function of DCT array coefficient position, from the contrast sensitivity function array of FIG. 13c 
and the product is referred to as the cascade. 5 alone; and 

In accordance with a further aspect of the invention, FIGS. 15a and 156 illustrate the contrast sensitivity 
the bandwidth of the human visual contrast sensitivity functions for generating the normalization arrays for 
function is reduced for the color difference (R-G and the R-G image data blocks and the B-G image data 
B-G) signals in computing the normalization factors blocks, respectively. 

S Sed f 7° • ^ 7*? adV<mta S .° f ^ 10 MODES FOR CARRYING OUT THE 

aspect of the invention is that it accommodates the INVENTION 
reduced spatial frequency response of the human visual 

system to the color difference signals R-G and B-G. Referring to FIG. 1, an image capture or recording 
The normalization arrays thus generated for the R-G system embodying one aspect of the invention receives 
and B-G data blocks for the data compression process 15 a ^ x from a sccnc through a lens 10, an aperture 
differ from the normalization array for the G data block 12 and a shutter 14. A blur filter 16 distributes the image 
in that they have a reduced frequency response and are m a nearlv uniform manner across the image plane of a 
non-isotropic due to the uneven distribution of red and color flltcr ""V ( CFA ) M «"* image sensor 20. The 
blue pixels in the 3G color filter array. In the preferred sensor 20 may be a charge coupled device (CCD) 

embodiment, a further distinction of the R-G and B-G 20 of type well-known in the art which produces an 
normalization arrays is that no compensation is made analo « * olta S e for ** ch one of M ***** of P« eIs m its 
for the edge enhancement and image display modula- ma * e CTA 18 preferably is an array of red, 

tion transfer functions * reen ** d ^ ,ue fdtcrs overlying respective ones of the 

All of the foregoing operations are performed on „ f^ 8 of * nsor 20 ' » * e = voltages produced by 
r-space R, G and B data without any intervening trans- 25 f! 1 ^! 180 * ^? re P r ** ent ^ ® (red^green and blue) 
formations. light intensity analog signals. The R, G and B analog 

image signals produced by the sensor 20 are amplified 

BRIEF DESCRIPTION OF THE DRAWINGS and processed by a conventional analog signal proces- 

The invention is described below in detail by refer- , n ?° r 2 f<™ e *! °" d * f c 
ence to the accompanying drawings, of which: 30 f 0rmed by « them t0 «P°^al power of l/r 

1 ; . n ui^i, j- — r a " m a conventional manner by a non-linear amplifier 24, 

FIG. 1 is a block diagram of an image recording * j ~ ^ • . r „ 1yr ' 

... 6 • - . *Z 6 to produce r-space analog image signals r=R 1/r , 

system embodying one aspect of the inventton; g=G»/r b =B^. The r, g and b T-space analog signals 

FIG. 2 is a block diagram of an unage playback sys- ^ then convcrtcd tQ ^ J b data (( f 
tern embodying another aspect of the invention; 35 bytes) b m vcrter u , Adata pro- 

* 3 ls a Wock diagram of the ^lorimage sensing ^ ^ ^^sor 28 temporarily stores the date in 
apparatus employed in he system of FIG. 1; a m 29 ^ then comp ^ ses f hc data . A ^ 

FIG. 4 is a graph of the r-space transformation em- recorder 30 records the comprcssed data on a ^ 
ployed in the invention; storage medium such as a disk. The foregoing compo- 

FIG. 5 is a flow diagram Ulustrating the image re- 40 nents are controlled by aeon vendonal tinimg circuit 32. 
cording process performed by the system of FIG. 1; Referring to FIG. 2, an image playback or reproduc- 

FIG. 6 is a flow diagram illustrating the image play- mg system embodying ^othtT aspect of the invention 
back process performed by the system of FIG. 2; mcludes a digital playback device 34 (such n 1 disk 

FIG. 7 is a block diagram depicting the three interpo- player or digital memory rea d-out) and a data decom- 
lated color data blocks produced by the process of FIG. 45 pressor and processor 35. The digital playback device 
' ™^ 34 receives either the stored image data SID recorded 

FIG. 8 is a block diagram illustrating the edge en- m me digita3 rec0 rder 30 of FIG. 1 or receives image 
hancement process and playback image processes per- data id directly from the data processor and compres- 
' fo 25i d ^ the SyS i em ° f HG * 2; sor 28 of FIG. 1. Tlie output of the decompressor 35 

FIG. 9 is a graph illustrating the response of a paring 50 may be transmitted cither to a video display processor 
filter in the edge enhancement circuit of FIG. 8; 36 or to a hardcopy print processor 37. The output of 

FIGS. 10a and 106 illustrate the data compression the video processor 36 is transmitted to a color video 
and data decompression processes performed by the display 38 while the output of the print processor 37 is 
systems of FIGS. 1 and 2, respectively; transmitted to a hardcopy color printer 39. 

FIG. 11 illustrates the spatial frequency transforma- 55 FIG. 3 illustrates the preferred apparatus for captur- 
tion process performed by the data compressor of FIG. big the image. The CFA 18 is a "3G" CFA of the well- 
10a in accordance with the present invention; known type comprising 1024 rows and 1280 columns of 

FIG. 12 illustrates the cascading of the human visual discrete color filter pixels in which every fourth color 
contrast sensitivity function with modulation transfer filter pixel row contains alternate red and blue pixels 
functions of the edge enhancement process and of the 60 while the remaining color filter pixels are green. The R, 
image display in generating the normalization arrays G and B pixels are in precise registration with respec- 
employed in the data compression process of FIG. 10fl tive light sensitive pixels 20A of the sensor 20. The 
and in the decompression process of FIG. 106; sensor 20 likewise comprises 1024 rows and 1280 col- 

FIGS. 13tf, 136, 13c and 13d illustrate arrays repre- umns of light sensitive pixels 20A. If the A/D converter 
senting, respectively, the edge enhancement modulation 65 26 of FIG. 1 produces 8-bit bytes, then 1024 rows and 
transfer function, the display modulation transfer func- 1280 columns of 8-bit pixels represent the image cap- 
tion, the human visual contrast sensitivity function and tured by the sensor 20. However, it should be under- 
an array formed by cascading the foregoing arrays; stood that the number of pixel rows and pixel columns, 
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the number of bits per pixel and the particular color filling in r-g and b-g color difference signals of the miss- 
pattern of the CFA 18 are all design choices which may ing red and green pixels prior to decompression, the 
be varied in practicing the invention. compression noise is reduced in the decompressed color 

n- e ^ fiL i i ~ « difference signals on the order of 60%. 

Transformation of the Image Signals to T-Spacc 5 6 

FIG. 4 illustrates the behavior of the T-transforma- Producing the T-Space Color Difference Signals for 
tion from an intensity I to an intensity I 1/r . FIG. 4 also Compression 
illustrates the log-transformation from I to log I for a Referring again to FIG. 5, the data processor 28 does 
pixel intensity I employed in the system of the patent not fill in the missing red and blue pixels prior to corn- 
application by Kenneth G. Parulski et al. referenced 10 pression, in accordance with the foregoing discussion, 
above. The T-transformation is somewhat more nearly However, the data processor 28 produces the T-space 
linear than the log-transformation and it so happens to color difference signals r-g and b-g prior to compression 
provide a superior result when combining or interpolate for those red and blue pixels which are not missing. In 
ing color difference signals. The main advantage of the order to accomplish this, the missing green pixels are 
T-space transformation discovered in the present inven- 15 computed at the site of each red or blue pixel. The 
tion, as will be described hereinbelow, is that no further missing green pixels gmware filled in (step 48 of FIG. 5) 
transformations are required in processing the image by interpolating the T-space green pixel data in each 
signals, and all image signals (green, red and blue) are column, in the following column pattern of the 3G CFA 
processed in the same color space (i.e., T-space), pro- 18: 
viding a significant economy of signal processing and 20 
computation. — ^— 

FIG. 5 is a flow diagram depicting successive steps of 81 
the process performed by the data processor and com- ^ 
pressor 28 of FIG. 1. The data processor 28 receives the gmist 
T-space image data from the A/D converter 26 repre- 25 g4 
senting the image captured by the image sensor 20 (step 85 

40 of FIG. 5). In step 41 of FIG. 5, the data processor 28 — 

temporarily stores the data in the memory 29 in three 

separate memory blocks or color data planes (depicted usm S the following center-weighted average: 
in FIG. 1) comprising a data plane or memory block 42 30 

of g (r-space green) pixels, a data plane or memory gmixs**j*xg\+£xgi+Cxgy+Cxg4+Bxg- 
block 44 of r (T-space red) pixels and a data plane or 3+ Xg6 

memory block 46 of b (r-space blue) pixels. In the pre- where* 
ferred embodiment, the g pixel memory block 42 has 
1 280 columns by 768 rows of 8-bit bytes, while each one 35 a<B<C 
of the b pixel and r pixel blocks 44 and 46 has 640 col- 
umns by 256 rows of 8-bit bytes. In a preferred embodiment: 
Compression Noise Reduction by Refraining from A=0.218 
Filling In Certain Missing Pixels ^ B=0.563 

w C= 0.844. 

In each pixel column of the image captured by the i„ step sq 0 f FIG. 5, the data processor 28 computes 
image sensor 20 every fourth green pixel is missing (as the T-space color difference signals r-g and b-g only for 
shown in FIG. 3), so that the missing green pixels must tho$e red and blue pixels present in the CFA array, 
be filled in by vertical interpolation. In alternate pixel there by refraining from filling in any missing red or blue 
columns of the captured image, only every fourth red 45 pixe ] s prior t0 compression. Thus, in step 50 the data 
pixel is present at the site of a missing green pixel. In the processor 28 subtracts from each T-space red pixel 
remaining columns of the captured image, only every value r the r . space value g^ of the corresponding 
fourth blue pixel is present. Therefore, the red and blue missing grccn pixe i t0 form the r-g color difference 
pixels must be interpolated both horizontally and verti- data . Likewise, the processor 28 also subtracts from 
cally to fill in the missing red and blue pixels. However, 50 each T-space blue pixel value b the T-space value gmic 
it is a discovery of the .invention that by refraining from of ^ corresponding missing green pixel to form the b-g 
filling in the missing pixels until after the image has been cojor tfflerence data. The operation of step 50 may be 
compressed, recorded, played back and then decom- summarized for the i* red or blue pixel as follows; 
pressed, noise in the reproduced image is significantly 

decreased in comparison with the alternative method in 55 (r-^-r/-M«m) ud 
which the missing pixels are filled in prior to compres- 
sion and recording. This discovery may be confirmed *v-$*Xmm) 

analytically in accordance with statistical methods, where (r-g),- is the value of the i tb r-g color difference 

In the case of the green image, the missing pixels pixel, r/ is the value of the i' A T-space red pixel and 
comprise J of all green pixels and the compression noise 60 BrKmiss) is the interpolated T-space value of the missing 
is reduced in accordance with the foregoing method of green pixel at the site of the \ th red pixel. Also, (b-g)/ is 
filling in missing pixels after decompression by about the value of the i f * b-g color difference pixel, b/ is the 
12.5% in the decompressed green pixels. As mentioned value of the X th T-space blue pixel and is the 

previously herein, the red and blue pixels each comprise ^interpolated T-space value of the missing green pixel at 
only i of all pixels in the image and, as will be discussed 65 the site of the i™ blue pixel 

below, the red and blue pixels are stored and com- In step. 52, the color difference data generated in step 
pressed in T-space as the T-space color difference sig- 50 is stored with the uninterpolated green pixel data in 
nals r-g and b-g. It can be shown that by refraining from the memory 29 in three separate memory blocks or 
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color data planes (shown in FIG. 1), comprising a mem- b m t a =gb mia +03x[(b-gh -§-(fr— 
ory block 54 of 1280 columns and 768 rows of 8-bit 

bytes representing the T-space green pixels, a memory where g^«yand gbmiss^ the green pixels at the sites of 

block 56 of 640 columns and 256 rows of 8-bit bytes the missing red and blue pixels x m ia and b M iu, respec- 

comprising the T-space r-g color difFerence data and a 5 tively. Of course, no such interpolation is necessary in 

memory block 58 of 640 columns and 256 rows of 8-bit computing (from the color difference signals) any red 

bytes comprising the b-g color difFerence data. The data and blue pixels n and bi which are not missing: 
representing the missing green pixels which were filled 

in to generate the color difference data is then dis- i=gn+('-*)i «nd 
carded. 10 

In step 61 of FIG. 5, the data processor 28 separately *> 
compresses the data stored in each of the memory 

blocks 54, 56, 58 of FIG. 1. The digital recorder 30 where md 8*1 m the interpolated missing green 

records the compressed data on data storage media in P lxe,s at the sitc of r » b * respectively and (r-g)i and 

step 62. 15 m tne color difference signals corresponding to 

FIG. 6 is a flow diagram depicting successive steps of '1 and bj. 

the playback process performed by the data processor The vertical interpolation step 74 of FIG. 6 fills in the 

35 of FIG. 2. The compressed data from the playback missing red and blue pixels that occur in every three out 

device 34 corresponds to the uncompressed data planes of four pixel rows. Following the horizontal intcrpola- 

or blocks 54, 56, 58 of FIG. 1. This data is decom- 20 tion ste P of block 72, the T-space red and blue pixels 

pressed by the data processor 35 in step 64 of FIG. 6 nave the following patterns for each pixel column: 
using the inverse of the compression process performed 

by the data processor 28 of FIG. 1 to produce decom- — 

pressed data corresponding to the color data planes or T J !*J . 

memory blocks 54, 56, 58 of FIG. 1. Then, in step 66 the 25 $"S 

missing green, red and blue pixels are computed by Hmu$s bt«top 

interpolation of the green (g) data and the r-g and b-g _^ 2 ^1 

color difference data to form a block 68 of T-space 

color image data illustrated in FIG. 7 having no missing The missing red pixels are vertically interpolated in 

pixels. The interpolation step 66 of FIG. 6 consists of 30 T-space in step 74 by adding corresponding green pixels 

three steps: the missing green pixels are first filled in by to color difference signals weighted in accordance with 

vertical interpolation (step 70 of FIG. 6), then missing their proximity to the missing red pixels, as follows: 
-color difference (r-g and b-g) pixels are horizontally 

interpolated (step 72 of FIG. 6) and then vertically tminii-*n«ta9i+-*>«n-ft}+*x(#a-«) 
. interpolated (step 74 of FIG. 6). Referring to FIG. 7, 35 

the block 68 comprises three arrays or color data planes f <»u»)2-*/(mtir}2+Cx(ri -gi)+Dx(n-gi) 
76, 77, 78 each consisting of 1280 columns and 1024 

rows of 8-bit bytes representing the T-space red, green 1m*iJ3-*/(m£B)3+-Ex<n-tt)+^('2-*2). 
and blue pixels, respectively. where g^m^/is the T-space value of the green pixel at 
The green pixel interpolation step 70 of FIG. 6 is 40 site ? f ^ * th missing red pixel T( misS )i, and gi and g 2 
carried out in the same manner as the green pixel inter- are lhe interpolated missing green pixel values at the 
polation step 48 of FIG. 5. The horizontal interpolation rites of ^ e red P ixels r i and r 2 . Preferably, in step 74, 
step 72 of FIG. 6 fills in the missing red and blue pixels A=F=0.75, C=D=0.5 and B=E^0.25. Ttie missing 
of every fourth pixel row of alternating r-g and b-g blue P ixeJs m vertically interpolated in the same man- 
pixels in the decompressed image data recovered by the 45 ner * 

decompression step 64. In every fourth pixel row of the * n summary, all of the pre-compression signal pro- 
decompressed data, a typical sequence of T-space r-g cessing including the computation of the color differ- 
pixels is: ence signals, the compression, the decompression and 

the post-decompression processing including the inter- 
(r-f>t; (r-g) mtS £ (r-g)i; . , , , 50 polation of all missing red, green and blue pixels is car- 
while a typical sequence of T-space b-g pixels is: ried out in T-space, no interim transformations of the 

data being necessary. The elimination of all interim 

(*-*)i; (*-f)«io; (*-*)2; • - . transformations provides a significant advantage in pro- 

where the subscript "miss" denotes a missing pixel. The „ ° f h " d WM? toa8C 

corresponding sequence of red and blue pixels in every T-Space Edge Enhancement Process 

fourth row of the CFA 18 of FIG. 3 is as follows: Upon ^ completion of the de-compression and in- 

'mi» i» - ■ • terpolation processes of FIG. 6, the data processor 35 of 

ma * FIG. 2 enhances or sharpens the T-space data of FIG. 7 

b h b mis , b* 60 representing the interpolated red, green and blue pixels 

in accordance with a T-space edge enhancement pro- 
where r m u, and b m £s,are the missing red and blue pixels cess of the invention. The data is prepared in a conven- 
in the CFA pattern. The horizontal interpolation of the tional manner for video display by the video processor 
missing T-space red and blue pixels using the decom- ^6 or prepared in a conventional manner for print-out 
pressed r-g and b-g T-space data is as follows: 65 by tne print processor 37. The edge enhancement pro- 

cess, the video, processing and the print processing are 
'mto«*/miB+o.5xt(r-g)i+(r-«)2) ™* illustrated in FIG. 8. As illustrated in FIG. 8, much of 

the edge enhancement process is performed in parallel 
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with the conventional video processing or in parallel 
with the conventional print processing. 

The r -space edge enhancement process 80 of FIG. 8 
requires as an input only the luminance-related (green) 
T-space data (i.e., block 77 of FIG. 7). This process 
begins with two separate bandpass filtering steps car- 
ried out simultaneously, namely a vertical bandpass 
filtering step 82 and a horizontal bandpass filtering step 
84. The bandpass filtering steps 82, 84 extract high spa- 
tial frequency components from the image which are to 
be added back into the original image to boost their 
amplitude in the original image, thereby sharpening the 
image. Using conventional transversal filtering tech- 
niques, the vertical bandpass filter step 82 computes a 
new value for each T-space green pixel based upon the 
value of neighboring pixels within the same column as 
the current pixel being processed. The vertical bandpass 
filter step 82 does this for each pixel in a given column 
and for each column of T-space green pixels in the data 
block 77 of FIG. 7. 

In similar manner and using conventional transversal 
filtering techniques, the horizontal bandpass filter step 
84 computes a new value for each T-space green pixel 
based upon the value of neighboring pixels within the 
same row as the current pixel being processed. The 
horizontal bandpass filter step 84 does this for each pixel 
in a given row and for each row of T-space green pixels 
in the data block 77 of FIG. 7. For each pixel, the new 
T-space value computed for it by the vertical bandpass 



amplitudes above an absolute value 32, the gain rapidly 
falls below unity until zero gain is reached at maximum 
input absolute value 255. Thus, for the highest ampli- 
tude high spatial frequency components (e.g., very 
5 sharp and contrasting edges) virtually no sharpening is 
performed because they are not boosted, a significant 
advantage. 

As will be described below, the enhanced or sharp- 
ened image or array of pixel values thus produced at the 
10 output of the paring step 90 is combined with all three 
blocks or planes of color data (red and blue as well as 
green). 

In the video processing step 94 performed by the 
video processor 36 of FIG. 2 and in the print processing 
step 96 performed by the print processor 37 of FIG. % 
the T-space r, g and b data is back-transformed to linear 
space (by computing the F power of the amplitude of 
each T-space pixel). Then, the video processing step 94 
and the pre-print processing step 96 employ conven- 
tional techniques to prepare the resulting R,G,B signal 
for output to a video display or printer, respectively. In 
particular, the color signals must be adjusted in accor- 
dance with the particular color response of the video 
monitor or the printer/print media. In the case of the 
printer and media, a further adjustment must be made to 
perform density correction using conventional tech- 
niques. The video processing step 94 and the pre-print 
processing step 96 then back-transform their color ad- 
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25 



filter step 82 and the new T-space value computed for it 30 justed data to T-space. The T-space green, red and blue 



by the horizontal bandpass filter step 84 are combined 
by an adding step 86 to produce a two-dimensionally 
bandpass filtered T-space pixel value reflecting the re- 
sults of both the vertical and horizontal bandpass filter 
steps 82, 84. 

One problem encountered in boosting the high spatial 
frequency image components is that more noise will be 
boosted along one axis than along the other. This is 
particularly true of images produced by a typical CCD 



pixel values output by the video processing step 94 are 
each combined in an adding and clipping step 98 with 
the corresponding sharpened pixel values output by the 
edge enhancement process 80 so that the video-proc- 
3^ essed green, red and blue video color images are each 
individually sharpened. The resulting video processed 
data is then sent to a color video display device. The 
T-space green, red and blue pixel values output by the 
print processing step 96 are each combined in an adding 



imaging array due to the row-by-row charge transfer ^ and olippin^ step 100 with corresponding sharpened 



process by which an image signal is extracted from the 
CCD array. In order to solve this problem, a low pass 
filter step 88 is interposed between the output of the 
vertical bandpass filter step 82 and the adding step 86. 
Preferably, using conventional transversal filtering 
techniques, the low pass filter step 88 computes a low 
pass filtered T-space value for each pixel based upon the 
two neighboring pixels immediately preceding and fol- 
lowing the current pixel in the data stream using the 
coefficient sequence 1-2-1. Thus, in a vertical column or 
sequence of three green pixels, gi, ga, g3, the low pass 
filtered T-space value of gz is computed as follows: 

Other suitable filter coefficient sequences may be se- 
lected by the skilled worker. 

Another problem with edge enhancing the image is 
that image features which are already very sharp may 
be further sharpened to an undesirably exaggerated 
degree. In order to solve this problem, the T-space 
image data produced by the adding step 86 is "pared" 
by a paring or filtering step 90. As used herein, paring 
refers to high amplitude attenuation. The non-linear 
transfer function of the paring step 90 is illustrated in 
FIG. 9 for an input amplitude range of 0 to 255 for 8-bit 
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pixel values output by the edge enhancement process 
80, so that the print processed green, red and blue im- 
ages are each individually sharpened. The resulting 
print processed image data is transformed in step 102 to 
another space compatible with a printer (such as log) 
and sent to a printer. 

Cascaded Modulation Transfer Functions for 
Controlling Bit Resolution of Each Component of the 
Compressed Image 

In order to solve the problem of the edge enhance- 
ment process making the compression-induced noise 
more visible in the image to the human eye, the edge 
enhancement process modulation transfer function is 
taken into account along with the human visual contrast 
sensitivity function in computing normalization factors 
which determine the bit resolution (i.e., number of rep- 
resentative bits) of respective spatial frequency compo- 
nents of the compressed data produced by step 61 of the 
process of FIG. 5. In order to compensate for the effect 
of the video display on the visibility to the human eye of 
compression-induced noise in the image, the display 
modulation transfer function is also taken into account 
in computing the normalization factors. In general, the 



data. The input signal is g tn and the output signal is gout- 65 modulation transfer functions of any steps in the image 



Essentially, for input amplitudes of absolute value zero 
through 32, a unity gain is provided. The absolute value 
of gout never exceeds 32 in this embodiment. For input 



recording/playback process tending to affect visibility 
to the human eye of compression noise may be cascaded 
together with the human visual contrast sensitivity 
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function in accordance with the invention to generate tion generating step 125' of FIG. 106 furnishes the re- 
an array of normalization factors for the compression ciprocals N-»(k) of the normalization factors. The 
process. This will now be described with reference to DCT coefficients T(k) are then reformatted into a 16- 
the compressing step 61 of FIG. 5 performed by the by-I6 block T(ij) in step 136 and inverse DCT trans- 
data compressor 28 of FIG. 1 and further with refer- 5 formed in step 138 to a 16-by-16 image block I(x,y). The 
ence to the decompressing step 64 of FIG. 6 performed image blocks thus generated are assembled together in 
T ^ ccom P r « so 5 35 of FIG. 2. ste p m t0 {orm the reproduce d g, r-g, or b-g image. 
FIG. 10a illustrates in detail the compression process FIG. 12 illustrates how the normalization array gen- 
performed in step 61 of FIG. 3 by the data processor 28. erating step 125 cascades the different modulation trans- 
Tms process begins by taking an individual one of theg, 10 fer f unctions and the human contrast sensitivity func- 
S? Z i ^vir T T° T I^ S or , c . ol # or data P lane * tion to form the normalization array N(k). In essence, 
54, 56, 58 (of FIG 1 and dividing it into many small the predominant spatial frequency of each DCT coeffi- 

^Z^t^H^ ifr F ? t 10 ^' ™ S den ^ lhe l6 - b y- U bl <** 2 estimated in different units 

ferred SSn£L^.S." f V^u ^ ,< suitable for correlation with modulation transfer tunc 

^J^^?^^^^ * tions ^ different processes (namely, the edge enhance- 

£r X? * ?^ IXel r I(X,> 2i R ffu mng agmn X °, ment P rocess . *e image display process and the human 

step 118, to generate a 16-by-16 block of DCT coeflici' ™£ Sj^SS^^ f^T* m 
ents T(i j). The DCT coefficient block is sequentialized 20 of each DCT coefficient based upon the specific 
in step 120 to a stream of DCT coefficients T(k). The P^ meters em P\° ye ^?L the ^tne transform 

number of encoded bits which will represent each coef- U fpi r 'w CT , coefficients. Next, in step 144 

ficient in the compressed data is then determined by a f FI ?/ 12 th \ numbcr c y c ^ Pf P«f 1 is computed 
normalization step 124 and a quantization step 126. The fro * tbe nun * er of c y<*es per block for each DCT 
normalization step 124 consists of dividing each DCT 25 efficient and from the number of pixel rows (B*) and 
coefficient T(k) in the sequentialized 16-by-16 DCT ooIunu,s (By) m each block, which in the preferred 
block by a normalization factor generated for that par- embodiment is 16 rows and 16 columns. The two-di- 
ticular coefficient by a normalization array generating mensi onal modulation transfer function of the edge 
step 125. The normalization step 124 produces a nor- enhancement process of FIG. 8 is readily generated by 
malized coefficient TN(k). The number of encoded bits 30 the sknied worker using ordinary techniques and is best 
which will represent the compressed version of the expressed in the dimension of step 144, namely cycles 
particular coefficient is inversely proportional, approxi- P er P"^- ™ e results of step 144 are exploited in step 
_ mateJy, to the amplitude of the normalization factor. 146 by associating an amplitude from the edge enhance- 
The quantization step 126 quantizes each normalized men ^ modulation transfer function with each DCT co- 
coefficient TN(k) to produce a quantized coefficient 35 efficient based upon its predominant spatial frequency 
tN(k). The normalized and quantized DCT coefficients in c y cIes per pixel. This produces a 16-by-16 edge en- 
1"N(k) are then minimum-redundancy (Huffman) en- hancement modulation transfer function array. In FIG. 
coded and run-length encoded in step 128 to produce tnc sna pe of the three dimensional surface corre- 

the encoded bits comprising compressed DCT coeffici- sponds to the two dimensional modulation transfer 
ents CV(k), which completes the compression process. 40 runction of the edge enhancement process 80 FIG. 8. 
As described in the above- referenced U.S. Pat. No. The intersection points in the grid superimposed on the 
4,780,763 to Scott J. Daly et al., the normalization array tnrcc dimensional surface of FIG. 13a are the ampli- 
generating step 125 generates a 16-by-16 array of nor- tudes associated with the individual DCT coefficients in 
maJization factors N(k) associated with the l6-by-16 step 146. 

block of DCT coefficients in such a manner as to com- 45 Next, in step 148 of FIG. 12 the number of cycles per 
pensate for the human visual contrast sensitivity func- unit distance (e.g., millimeters) is computed for each 
tion. In accordance with the present invention, the DCT coefficient from the number of cycles per pixel 
normalization array generating step 125 further com- an <* from the pixel-to-pixel spacing Pjc, Pp of the CFA 
pensates for the modulation transfer functions of the 18 of FIG. 3 for example. The two-dimensional modula- 
edge enhancement process (or any other image signal 50 tion transfer function of the image display is readily 
process as desired) and of the image display, as will be generated by the skilled worker using ordinary tech- 
described below. niques from the known characteristics of the image 
FIG. 106 illustrates in detail the decompression pro- display (video monitor or print media) to be employed 
• cess performed in step 64 of FIG. 6 by the data proces- and is best expressed in units of cycles per unit distance 
sor 35. In the first step of this process (step 130 of FIG. 55 (millimeters). This follows from the fact that the per- 
106), the compressed DCT coefficients CV(k) are de- ception of texture and edges in printed media, for exam- 
coded in accordance with the minimum redundancy pie, is affected by the pixel spacing on the media. Then, 
(Huffman) codes and run length codes to produce the step 150 exploits the results of step 148 by associating an 
normalized coefficients TN(k). Tlie normalized coeffi- amplitude from the display modulation transfer function 
cients are denormalized in step 132 to produce the DCT 60 with each DCT coefficient based upon its spatial fre- 
coefficients T(k). The denormalization step 132 is ac- quency in cycles per millimeter. This produces a I6-by- 
complished by multiplying each DCT coefficient by the 16 image display modulation transfer function array. In 
same normalization factor by which it was previously FIG. 136, the shape of the three dimensional surface 
divided in the compression process. For this purpose, corresponds to the two dimensional modulation transfer 
the normalization array generating step 125 of the com- 65 function of the image display. The intersection points in 
pression process of FIG. 10a is repeated as the normal- the grid superimposed on the three dimensional surface 
ization array generating step 125' in the decompression of FIG. 136 are the amplitudes associated with the indi- 
process of FIG. 106. In one embodiment, the normaliza- vidual DCT coefficients in step 150. 
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Next, in step 152 the number of cycles per degree of 
the visual angle (or subtense) is computed for each 
DCT coefficient from the number of cycles per millime- 
ter and from the assumed distance V between the 
viewer and the display. The two-dimensional human 5 
visual contrast sensitivity function (CSF) is obtained in 
accordance with the teachings of the above-referenced 
U.S. Pat. No. 4,780,761 to Scott J. Daly et al. and is best 
expressed in units of cycles per degree of visual degree. 
One aspect of the CSF reflects the eye's perception of 10 
high spatial frequencies being affected by the distance 
to the image. There are other aspects also which need 
not be mentioned herein. Step 134 of FIG. 12 exploits 
the results of step 152 by associating an amplitude from J5 
the human visual contrast sensitivity function with each 
DCT coefficient based upon its spatial frequency in 
cycles per degree. The result is a 16-by-16 human con- 
trast sensitivity function array. In FIG. 13c, the shape of 
the three dimensional surface corresponds to the two 20 
dimensional contrast sensitivity function of the image 
display. The intersection points in the grid superim- 
posed on the three dimensional surface of FIG. 13c are 
the amplitudes associated with the individual DCT 
coefficients in step 154. 25 

The display and edge enhancement modulation trans* 
fer function arrays are multiplied together in a multipli- 
cation step 156 coefficient -by-coefficient and the result- 
ing 16-by-16 product array is multiplied by the contrast 
sensitivity array in a multiplication step 158 to produce 30 
a cascaded array illustrated in FIG. 13d. Each element 
of the resulting cascaded array is converted to its recip- 
rocal in step 160 and multiplied by a bit rate factor to 
produce the normalization array illustrated in FIG. 14a. 
The normalization array may then be loaded into a 35 
look-up table, for example. The result (FIG. 14a) con- 
trasts dramatically with the normalization array of FIG. 
146 (disclosed in the above-referenced U.S. Patent to 
Scott Daly et al.) which takes into account the human ^ 
visual contrast sensitivity function only. 

In order to compensate for the lower spatial fre- 
quency response of the eye to color difference signals, 
different normalization arrays are produced by the nor- 
malization array generating step 125 for use in com- 45 
pressing the r-g and b-g color difference signals. For 
this purpose, the normalization array generating step 
125 of FIG. 10a is depicted as three generating in steps 
125a, 1256, 125c, labelled "green", "red-green" and 
"blue-green", respectively. The appropriate one of the 50 
normalization array generating steps 125a, 1256, 123c is 
selected depending upon whether the green signal or 
one of the color difference signals is to be compressed. 
Thus, a different normalization array is used with each 
of the g, r-g and b-g data blocks. Likewise, the normal- 55 
ization array generating step 125' of FIG. 106 is divided 
into separate normalization array generating steps 
125'fl, 125'6, 125'c 

The normalization arrays for the color difference 
signals compensate for the lower frequency human 60 
visual response to the color difference signals by alter- 
ing the human visual contrast sensitivity function model 
described in the above-referenced U.S. Pat No. 
4,780,764 to Scott J. Daly et al. Specifically, the fre- 
quency variable r in the human visual contrast sensitiv- * 5 
ity function model equation 

H(r) =HAX (HB+ HCx r)exp(- HCx 
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is multiplied by a factor greater than one. For the r-g 
color difference data block, this factor preferably equals 
2 and the model equation thus becomes: 

H(r)=HAx(HB+ HCx 2r)£x^(- HCx lr)» D 
for the r-g color difference signal. For the b-g color 
difference data block, the factor preferably equals 4. 
This reduces the effective bandwidth of the resulting 
contrast sensitivity function, thus accommodating the 
lower frequency response of the eye to the color differ- 
ences r-g and b-g compared with the eye's response to 
green. The remaining steps in generating the 2-dimen- 
sional human visual contrast sensitivity function and 
producing therefrom the 16-by-16 contrast sensitivity 
function array are described m the above-referenced 
U.S. patent to Daly et al. and need not be described 
herein. 

Because the CFA has different pixel-to-pixel spacings 
or patterns for different colors (illustrated in FIG. 3) 
and because the factors for the frequency variable r are 
different for the r-g and b-g blocks, the steps of FIG. 12 
produce a different normalization array for each of the 
color difference signals. For example, the r-g normaliza- 
tion array is illustrated in FIG. 15a and the b-g normal- 
ization array is illustrated in FIG. 15& 

While the invention has been described with refer- 
ence to a preferred embodiment using a 3G CFA in 
which the luminance-related color is green and the 
chrominance-related signals are r-g and b-g, other 
CFA's having different color schemes, different spatial 
patterns and a different luminance-related color as well 
as a different set of chrominance-related or color differ- 
ence signals may be employed in carrying out the inven- 
tion. 

While the invention has been described in detail by 
specific reference to preferred embodiments thereof, 
modifications and variations thereof may be made with- 
out departing from the true spirit and scope of the in- 
vention. 

What is claimed is: 

1. Apparatus for transmitting and receiving a color 
image signal representing the amplitudes of a single 
image plane of pixels, each one of said pixels represent- 
ing a respective one of three different colors whereby 
pixels of pairs of said colors are missing at sites of re- 
spective individual pixels, one of said three colors being 
more closely related to luminance than the remaining 
colors, said apparatus comprising: 

A) transmitting means comprising: 

1) means for transforming the amplitude of each of 
said pixels to a T-space amplitude by changing its 
original value A to A ,/r f where T is a real num- 
ber, whereby the T-space amplitudes of the pix- 
els of said one color comprise a fust input color 
data plane; 

2) first means for inferring by interpolation the 
T-space amplitudes of the missing pixels of said 
one color; 

3) means for forming second and third input color 
data planes of respective color difference signals 
by subtracting the T-space amplitudes of said 
missing pixels of said one color from the T-space 
amplitudes of corresponding pixels of each of 
said remaining colors, respectively; 

4) means for compressing each of said input color 
data planes to form corresponding first, second 
and third compressed color data planes; 

B) receiving means comprising: 
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1) means for decompressing said first, second and 
third compressed color data planes to form, re- 
spectively, first, second and third decompressed 
color data planes; 

2) means for converting said first, second and third 5 
decompressed color data planes to first, second 
and third output color data planes, respectively, 
of T-space amplitudes of pixels of respective 
ones of said three colors; 

3) means for edge enhancing said first, second and 10 
third output color data planes; and 

4) means for back-transforming each of the T-space 
amplitudes A !/r of the pixels of said output color 
data planes to amplitudes A. 

2. The apparatus of claim 1 wherein said image plane IS 
corresponds to a color filter array, said one color re- 
lated to luminance is green and said remaining colors 
are red and blue and wherein T is about 2.4. 

3. The apparatus of claim 1 wherein said transmitting 
means further comprise means for recording said com- 20 
pressed color data planes and wherein said receiving 
means further comprise means for playing back the 
compressed color data planes recorded by said means 
for recording. 

4. The apparatus of claim 1 wherein said means for 25 
converting comprise means for determining from said 
decompressed color data planes T-space amplitudes of 
missing pixels of said three colors. 

5. The apparatus of claim 4 wherein said means for 
determining comprises: 30 

first means for computing from said first decom- 
pressed color data plane interpolated T-space am- 
plitudes of missing pixels of said one color to pro- 
duce said first output color data plane; 

first means for adding said interpolated T-space am- 35 
plitudes of said one color to corresponding T-space 
color difference signal amplitudes of said second 
and third decompressed color planes. 

6. The apparatus of claim 5 wherein said means for 
determining further comprises: 40 

second means for computing from said second and 
third decompressed color data planes interpolated 
T-space amplitudes of color difference signals cor- 
responding to missing pixels of said remaining col- 
ors; and 45 

second means for adding T-space amplitudes of pixels 
of said first decompressed color data plane to cor- 
responding ones of said interpolated color differ- 
ence signal T-space amplitudes computed by said 
second means for computing, to produce interpo- 50 
Iated T-space amplitudes of the missing pixels of 
said remaining colors. 

7. The apparatus of claim 6 wherein said image plane 
comprises pixei columns and pixel rows in a planar 
array of said pixels and said color related to luminance 55 
is green and has missing pixels in every n rA pixel row of 
said image plane and said remaining colors are red and 
blue and have alternate pixels in every n f * pixel row of 
said image plane, whereby said color difference signals 
correspond to red minus green and blue minus green, 60 
and wherein: 

said first means for computing comprises means for 
vertically interpolating T-space amplitudes of miss- 
ing green pixels within each pixel column of said 
first decompressed color data plane; 65 

said second means for computing comprises: 
(1) means for horizontally interpolating color dif- 
ference signal T-space amplitudes corresponding 
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to missing red and blue pixels in respective rows 
of said second and third compressed color data 
planes, and 

(2) means for vertically interpolating color differ- 
ence signal T-space amplitudes corresponding to 
missing red and blue pixels in each pixel column 
of said second and third compressed color data 
planes. 

3. The apparatus of claim 4 wherein said first output 
color data plane corresponds to said one color related to 
luminance and wherein said means for edge enhancing 
comprises: 

means for bandpass filtering each pixel column of 
T-space pixel amplitudes of said first output color 
data plane to produce a corresponding column of 
bandpass filtered T-space pixel amplitudes; 

means for bandpass filtering each pixel row of T- 
space pixel amplitudes of said first output color 
data plane to produce a corresponding row of 
bandpass filtered T-space pixel amplitudes; 

means for combining said bandpass filtered pixel rows 
and columns to produce two-dimensionally band- 
pass filtered T-space pixel amplitudes; 

means for paring said two-dimensionally bandpass 
filtered T-space amplitudes whereby to boost high 
spatial frequency components having lower ampli- 
tudes and suppress high spatial frequency compo- 
nents having higher amplitudes; and 

means for adding the T-space pixel amplitudes pro- 
duced by said means for paring to amplitudes of 
corresponding pixels in each of said first, second 
and third output color data planes. 

9. The apparatus of claim 8 wherein said columns of 
bandpass filtered amplitudes have greater high spatial 
frequency noise than said rows of bandpass filtered 
amplitudes, said apparatus further comprising: 

means for low pass filtering said columns of bandpass 
filtered amplitudes. 

10. The apparatus of claim S further comprising 
means for output color adjusting said amplitudes of the 
pixels of said output color data planes. . 

11. The apparatus of claim 1 wherein: 

A) said means for compressing comprises: 

1) means for dividing each of said input color data 
planes into transform blocks, 

2) means for transforming the T-space amplitudes 
of each of said transform blocks into spatial fre- 
quency coefficients, 

3) means for determining the number of encoded 
bits to represent each of said spatial frequency 
coefficients in compressed versions of said coef- 
ficients in accordance with a cascaded modula- 
tion transfer function corresponding to modula- 
tion transfer functions of selected elements of 
said apparatus, 

4) encoding means for producing said encoded bits; 
and 

B) wherein said means for decompressing comprises; 

1) means for converting said encoded bits to de- 
compressed spatial frequency coefficients, 

2) means for back-transforming said decompressed 
spatial frequency coefficients of each transform 
block to pixel amplitudes. 

12. The apparatus of claim 11 wherein said means for 
determining the number of encoded bits to represent 
each spatial frequency coefficient comprises: 
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means for producing a normalization array corre- 
sponding to said cascaded modulation transfer 
function; 

means for dividing each spatial frequency coefficient 
by a corresponding element of said normalization 5 
array whereby to produce first normalized coeffici- 
ents; and 

means for quantizing said first normalized coeffici- 
ents. 

13. The apparatus of claim 12 further comprising 10 
means for displaying an image of pixel amplitudes pro- 
duced by the back-transforming means, wherein said 
cascaded modulation transfer function corresponds to 
modulation transfer functions of said means for edge 
enhancing and of said means for displaying. 15 

14. The apparatus of claim 13 wherein said cascaded 
modulation transfer function further corresponds to a 
human visual contrast sensitivity function. 

15. The apparatus of claim 14 wherein said means for 
producing said normalization array corresponding to 20 
said cascaded modulation transfer function comprises: 

means for determining from the number of pixel rows 
and pixel columns in each of said transform blocks 
the number of cycles per pixel of each of said spa- 
tial frequency coefficients and means for associat- 25 
ing each coefficient with a value of a modulation 
transfer function of said means for edge enhancing 
at a corresponding spatial frequency in cycles per 
pixel whereby to form an edge enhancement modu- 
lation transfer function array; 30 

means for determining from pixel spacing corre- 
sponding to said means for displaying the number 
of cycles per unit distance of each of said spatial 
frequency coefficients and means for associating 
each coefficient with a value of a modulation trans- 35 
fer function of said means for displaying at a corre- 
sponding spatial frequency in cycles per unit dis- 
tance whereby to form a display modulation trans- 
fer function array; 

means for determining from a viewing distance corre- 40 
sponding to said means for displaying the number 
of cycles per degree of visual scan of each of said 
spatial frequency coefficients and means for asso- 
ciating each coefficient with a value of a human 
visual contrast sensitivity function at a correspond- 45 
ing spatial frequency in cycles per degree whereby 
to form a human visual contrast sensitivity function 
array; 

means for cascading said arrays together whereby to 
form a cascaded array of plural elements compris- 50 
ing said cascaded modulation transfer function; and 

means for inversing each element of the cascaded 
array. 

16. The apparatus of claim 12 wherein said means for 
converting said encoded bits to decompressed spatial 55 
frequency coefficients comprises: 

means for decoding said encoded bite whereby to 
produce second normalized spatial frequency coef- 
ficients; and 

means for multiplying said second normalized spatial 60 
frequency coefficients by corresponding elements 
of said normalization array whereby to produce 
said decompressed spatial frequency coefficients. 

17. The apparatus of claim 15 further comprising , 
means for reducing the bandwidth of said human visual 65 
contrast sensitivity function by a predetermined factor 
whenever said means for compressing compresses said 
second or third input color data planes. 
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18. The apparatus of claim 17 wherein the spatial 
patterns of the pixels of said three colors in said image 
plane are different, whereby said means for determining 
the number of cycles per unit distance of said spatial 
frequency coefficients produce different normalization 
arrays depending upon which one of said first, second 
or third input color data planes is being compressed. 

19. The apparatus of claim 17 wherein said second 
and third input color data planes comprise red minus 
green and blue minus green color difference signals and 
wherein said predetermined factor is 2 for said second 
input color data plane and 4 for said third input color 
data plane. 

20. The apparatus of claim 11 wherein said means for 
transforming to spatial frequency coefficients performs 
a discrete cosine transform process, and wherein said 
means for producing said encoded bits comprises means 
for encoding each of said spatial frequency coefficients 
in accordance with a minimum redundancy code. 

21. Apparatus for transmitting and receiving image 
data as arrays of pixels comprising: 

means for sectioning the arrays of pixels into plural 
blocks of pixels; 

means for spatial frequency transforming each of said 
blocks of pixels to form two-dimensional arrays of 
spatial frequency coefficients; 

means for determining the number of cycles per pixel 
of each of said spatial frequency coefficients from 
the number of pixels in each row and column of a 
two-dimensional array of pixels wherein each pixel 
is associated with two positional indices; 

edge enhancement modulation transfer function 
means for associating the two positional indices of 
each spatial coefficient with an associated value of 
an edge enhancement modulation transfer function 
at a corresponding spatial frequency in cycles per 
pixel to form an edge enhancement modulation 
transfer function array; 

means for determining the number of cycles per unit 
distance of each of said spatial frequency coeffici- 
ents form pixel spacing; 

display modulation transfer function means for asso- 
ciating the two positional indices of each spatial 
frequency coefficient with an associated value of 
the display modulation transfer function in cycles 
per unit distance to form a display modulation 
transfer function array; 

means for determining the number of cycles per de- 
gree of visual angle of each of said spatial fre- 
quency coefficients from a viewing distance; 

human visual contrast sensitivity means for associat- 
ing the two positional indices of each spatial fre- 
quency coefficient with an associated value of a 
human visual contrast sensitivity function in cycle 
per degree to form a visual contrast sensitivity 
function array; and 

means for combining said function arrays together to 
form a cascaded array the output of which is a 
normalization array. 

22. The apparatus of claim 21 wherein said arrays 
represent, respectively, a luminance related component 
and a pair of color difference components of a color 
image, said apparatus further comprising means for 
reducing the bandwidth of said human visual contrast 
sensitivity function by a predetermined factor for apply- 
ing the normalization array to different color difference 
component. 
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23. The apparatus of claim 22 wherein the spatial 
patterns of the pixels of said components are different, 
whereby said means for determining the number of 
cycles per unit distance of said spatial frequency coeffi- 
cients produces different normalization arrays depend- 5 
ing upon which one of the arrays of said image compo- 
nents is used. 

24. The apparatus of claim 22 wherein said color, 
difference components comprise red minus green and 
blue minus green color difference components and 1° 
wherein said predetermined factor is 2 for the red minus 
green component and 4 for the blue minus green com* 
ponent. 

25. Apparatus for edge enhancing a color image com- 
prising three arrays of rows and columns of pixel ampli- 15 
tudes corresponding to three colors, one of said colors 
being more related to luminance than the others, com- 
prising: 

means for bandpass filtering each column of pixel 
amplitudes of said color related to luminance to 20 
produce a corresponding column of bandpass Fil- 
tered pixel amplitudes; 

means for bandpass filtering each row of pixel ampli- 
tudes of said color related to luminance to produce - 
a corresponding row of bandpass filtered pixel 
amplitudes; 

means for combining said bandpass filtered pixel rows 
and columns to produce two-dimensionally band- 
pass filtered pixel amplitudes; ^ 

means for paring said two-dimensionally bandpass 
filtered amplitudes so as to boost high spatial fre- 
quency components having lower amplitudes and 
so as to attenuate high spatial frequency compo- 
nents having higher amplitudes; and 35 

means for adding the two-dimensionally bandpass 
filtered pixel amplitudes to corresponding ampli- 
tudes of the pixels of each of said three colors. 

26. The apparatus of claim 25 wherein each column 
of bandpass filtered amplitudes has more noise than 
each row, said apparatus further comprising: 

means for low pass filtering each column of bandpass 
filtered amplitudes. 

27. The apparatus of claim 25 further comprising 
means for output color adjusting said corresponding 45 
amplitudes of the pixels of said three colors. 

28. Apparatus for transmitting a color image signal 
representing the amplitudes of a single image plane of 
pixels, each one of said pixels representing a respective 
one of three different colors whereby pixels of pairs of 50 
said colors are missing at sites of respective individual 
pixels, one of said three colors being more closely re- 
lated to luminance than the remaining colors, said appa- 
ratus comprising: 

means for transforming the amplitude of each of said 55 
pixels to a T-space amplitude by changing its origi- 
nal value A to A 1 /*", where T is a real number, 
whereby the T-space amplitudes of the pixels of 
said one color comprise a first input color data 
plane; 60 

first means for inferring by interpolation the T-space 
amplitudes of the missing pixels of said one color; 

means for forming second and third input color data 
planes of respective color difference signals by 
subtracting the T-space amplitudes of said missing 65 
pixels of said one color from the T-space ampli- 
tudes of corresponding pixels of each of said re- 
maining colors, respectively; and 
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means for compressing each of said input color data 
planes to form corresponding first, second and 
third compressed color data planes. 

29. The apparatus of claim 23 wherein said image 
plane corresponds to a color filter array, said one color 
related to luminance is green and said remaining colors 
are red and blue and wherein T is about 2.4. 

30. The apparatus of claim 28 further comprising 
means for recording said compressed color data planes. 

31. The apparatus of claim 28 wherein said means for 
compressing comprises: 

1) means for dividing each of said input color data 
planes into transform blocks, 

2) means for transforming the T-space amplitudes of 
each of said transform blocks into spatial frequency 
coefficients, 

3) means for determining the number of encoded bits 
to represent each of said spatial frequency coeffici- 
ents in compressed versions of said coefficients in 
accordance with a cascaded modulation transfer 
function corresponding to modulation transfer 
functions of image output elements, and 

4) encoding means for producing said encoded bits. 

32. The apparatus of claim 31 wherein said means for 
determining the number of encoded bits to represent 
each spatial frequency coefficient comprises: 

means for producing a normalization array corre- 
sponding to said cascaded modulation transfer 
function; 

normalization means for dividing each spatial fre- 
quency coefficient by a corresponding element of 
said normalization array whereby to produce first 
normalized coefficients; and 

means for quantizing said first normalized coeffici- 
ents. 

33. The apparatus of claim 32 wherein said cascaded 
modulation transfer function corresponds to modula- 
tion transfer functions of an edge enhancing apparatus 
and of an image displaying apparatus. 

34. The apparatus of claim 33 wherein said cascaded 
modulation transfer function further corresponds to a 
human visual contrast sensitivity function. 

35. The apparatus of claim 34 wherein said means for 
producing said normalization array corresponding to 
said cascaded modulation transfer function comprises: 

means for determining from the number of pixel rows 
and pixel columns in each of said transform blocks 
the number of cycles per pixel of each of said spa- 
tial frequency coefficients and means for associat- 
ing each coefficient with a value of the modulation 
transfer function of said edge enhancing apparatus 
at a corresponding spatial frequency in cycles per 
pixel whereby to form an edge enhancement modu- 
lation transfer function array; 

means for determining from pixel spacing corre- 
sponding to the displaying means the number of 
cycles per unit distance of each of said spatial fre- 
quency coefficients and means for associating each 
coefficient with a value of the modulation transfer 
- function of said image displaying apparatus at a 
corresponding spatial frequency in cycles per unit 
distance whereby to form a display modulation 
transfer function array; 

means for determining from a viewing distance corre- 
sponding to said image displaying apparatus the 
number of cycles per degree of visual scan of each 
of said spatial frequency coefficients and means for 
associating each coefficient with a value of the 
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human visual contrast sensitivity function at a cor- 
responding spatial frequency in cycles per degree 
whereby to form a human visual contrast sensitiv- 
ity function array; and 

means for cascading said arrays together whereby to 5 
form a cascaded array of plural elements compris- 
ing said cascaded modulation transfer function; and 

means for inversing each element of the cascaded 
array to form said normalization array. 

36. The apparatus of claim 35 further comprising 10 
means for reducing the bandwidth of said human visual 
contrast sensitivity function by a predetermined factor 
whenever said means for compressing compresses said 
second or third input color data planes. 

37. The apparatus of claim 36 wherein the spatial 15 
patterns of the pixels of said three colors in said image 
plane are different, whereby said means for determining 
the number of cycles per unit distance of said spatial 
frequency coefficients produce different normalization 
arrays depending upon which one of said first, second 20 
or third input color data planes is being compressed. 

38. The apparatus of claim 36 wherein said second 
and third input color data planes comprise red minus 
green and blue minus green color difference signals and 
wherein said predetermined factor is 2 for said second 25 
input color data plane and 4 for said third input color 
data plane. 

39. The apparatus of claim 31 wherein said means for 
transforming to spatial frequency coefficients comprises 
means for performing a discrete cosine transform, and 30 
wherein said means for producing said encoded bits 
comprises means for encoding each of said spatial fre- 
quency coefficients in accordance with a minimum 
redundancy code. 

40. An apparatus for forming a normalization array, 35 
utilizing a two-dimensional array whose indices repre- 
sent the spatial frequency coefficients resulting from the 
transformation of a digital image comprising: 

means for determining the number of cycles per pixel 
of each of said spatial frequency coefficients from 40 
the number of pixels in each row and column of a 
two dimensional array of pixels wherein each pixel 
is associated with two positional indices; 

edge enhancement modulation transfer function 
means for associating the two positional indices of 45 
each spatial coefficient with an associated value of 
an edge enhancement modulation transfer function 
at a corresponding spatial frequency in cycles per 
pixel to form an edge enhancement modulation 
transfer function array; 50 

means for determining the number of cycles per unit 
distance of each of said spatial frequency coeffici- 
ents form pixel spacing; 

display modulation transfer function means for asso- 
ciating the two positional indices of each spatial 55 
frequency coefficient with an associated value of 
the display modulation transfer function in cycles 
per unit distance to form a display modulation 
transfer function array; 

means for determining the number of cycles per de- 60 
gree of visual angle of each of said spatial fre- 
quency coefficients from a viewing distance; 

human visual contrast sensitivity means for associat- 
ing the two positional indices of each spatial fre- 
quency coefficient with an associated value of a 65 
human visual contrast sensitivity function in cycle 
per degree to form a visual contrast sensitivity 
function array; and 
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means for combining said function arrays together to 
form a cascaded array the output of which is a 
normalization array. 

41. The apparatus of claim 40 wherein said arrays of 
pixels represent, respectively, a luminance related com- 
ponent and a pair of color difference components of a 
color image, said apparatus further comprising means 
for reducing the bandwidth of said human visual con- 
trast sensitivity function by a predetermined factor for 
applying the normalization array to different color dif- 
ference component. 

42. The apparatus of claim 41 wherein the spatial 
patterns of the pixels of said components are different, 
whereby said means for determining the number of 
cycles per unit distance of said spatial frequency coeffi- 
cients produces different normalization arrays depend- 
ing upon which one of the arrays of said image compo- 
nents is used. 

43. The apparatus of claim 41 wherein said color 
difference components comprise red minus green and 
blue minus green color difference components and 
wherein said predetermined factor is 2 for the red minus 
green component and 4 for the blue minus green com- 
ponent. 

44. Apparatus for receiving a color image signal com- 
prising compressed data corresponding to T-space am- 
plitudes A I/r of a single image plane of pixels, each one 
of said pixels representing a respective one of three 
different colors whereby pixels of pairs of said colors 
are missing at sites of respective individual pixels, one of 
said three colors being more closely related to lumi- 
nance than the remaining colors, said compressed data 
comprising a first compressed color data plane compris- 
ing the T-space amplitudes of the pixels of said one 
color and second and third compressed color data 
planes comprising respective color difference signals 
formed by subtracting interpolated T-space amplitudes 
of missing pixels of said one color from the T-space 
amplitudes of corresponding pixels of each of said re- 
maining colors, respectively, said apparatus comprising: 

means for decompressing said compressed data to 
form first, second and third decompressed color 
data planes of T-space amplitudes corresponding to 
said first, second and third compressed color data 
planes, respectively; 

means for converting said first, second and third de- 
compressed color data planes to first, second and 
third output color data planes, respectively, of 
T-space amplitudes of pixels of respective ones of 
said three colors; 

means for edge enhancing said first, second and third 
output color data planes; and 

means for back-transforming each of the T-space 
amplitudes A l/r of the pixels of said output color 
data planes to amplitudes A. 

45. The apparatus of claim 44 wherein said image 
plane corresponds to a color filter array, said one color 
related to luminance is green and said remaining colors 
are red and blue and wherein T is about 2.4. 

46. The apparatus of claim 44 wherein said color 
image signal has been previously recorded, said appara- 
tus further comprising means for playing back said 
color image signal. 

47. The apparatus of claim 44 wherein said means for 
converting comprises means for determining from said 
decompressed color data planes T-space amplitudes of 
missing pixels of said three colors. 
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48. The apparatus of claim 47 wherein said means for 
determining comprises: 

first means for computing from said first decom- 
pressed color data plane interpolated T-space am- 
plitudes of missing pixels of said one color to pro- 
duce said first output color data plane; 

first means for adding said interpolated T-space am- 
plitudes of said one color to corresponding T-space 
color difference signal amplitudes of said second 
and third decompressed color planes. 

49. The apparatus of claim 48 wherein said means for 
determining further comprises: 

second means for computing from said second and 
third decompressed color data planes interpolated 
T-space amplitudes of color difference signals cor- 
responding to missing pixels of said remaining col- 
ors; and 

second means for adding T-space amplitudes of pixels 
of said first decompressed color data plane to cor- 
responding ones of said interpolated color differ- 
ence signal T-space amplitudes computed by said 
second means for computing, whereby to produce 
interpolated T-space amplitudes of the missing 
pixels of said remaining colors. 

50. The apparatus of claim 49 wherein said image 
plane comprises pixel columns and pixel rows in a pla- 
nar array of said pixels and said color related to lumi- 
nance is green and has missing pixels in every n' A pixel 
row of said image plane and said remaining colors are 
red and blue and have alternate pixels in every n'* pixel 
row of said image plane, whereby said color difference 
signals correspond to red minus green and blue minus 
green, and wherein: 

said first means for computing comprises means for 
vertically interpolating T-space amplitudes of miss- 35 
ing green pixels within each pixel column of said 
first decompressed color data plane; 
said second means for computing comprises: 
means for horizontally interpolating color differ- 
ence signal T-space amplitudes corresponding to 40 
missing red and blue pixels in respective pixel 
rows of said second and third compressed color 
data planes, and 
means for vertically interpolating color difference 
signal T-space amplitudes corresponding to miss- 
ing red and blue pixels in each pixel column of 
said second and third compressed color data 
planes. 

51. The apparatus of claim 47 wherein said first out- 
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means for adding the T-space pixel amplitudes pro- 
duced by said means for paring to amplitudes of 
corresponding pixels in each of said first, second 
and third output color data planes. 

52. The apparatus of claim 51 wherein said columns 
of bandpass filtered amplitudes have greater high spatial 
frequency noise than said rows of bandpass filtered 
amplitudes, said apparatus further comprising: 

means for low pass filtering said columns of bandpass 
filtered amplitudes. 

53. The apparatus of claim 51 further comprising 
means for output color adjusting said amplitudes of the 
pixels of said output color data planes. 

54. The apparatus of claim 44 wherein said com- 
pressed data comprises compressed normalized spatial 
frequency coefficients and wherein said means for de- 
compressing comprises: 

1) means for producing decompressed normalized 
coefficients from said compressed normalized coef- 
ficients, 

2) means for denormalizing said decompressed coeffi- 
cients in accordance with a cascaded modulation 
transfer function corresponding to modulation 
transfer functions of selected elements of said appa- 
ratus, whereby to produce denormalized spatial 
frequency coefficients, 

3) means for back-transforming respective transform 
blocks of the denormalized spatial frequency coef- 
ficients to blocks of pixel amplitudes whereby to 
produce said first, second and third decompressed 
color data planes. * 

55. The apparatus of claim 54 wherein said means for 
producing decompressed normalized coefficients com- 
prises: 

means for decoding said recorded data in accordance 
with a minimum redundancy code whereby to 
produce said decompressed normalized spatial fre- 
quency coefficients; and 
wherein said means for denormalizing comprise: 
means for multiplying said decompressed normalized 
spatial frequency coefficients by corresponding 
elements of a normalization array corresponding to 
said cascaded modulation transfer function 
whereby to produce said denormalized spatial fre- 
quency coefficients. 

56. The apparatus of claim 55 further comprising 
means for displaying an image comprising pixel ampli- 
tudes produced by the back-transforming means, 
wherein said cascaded modulation transfer function 



put color data plane corresponds to said one color re- 50 corresponds to modulation transfer functions of said 



lated to luminance and wherein said means for edge 
enhancing comprises: 

means for bandpass filtering each pixel column of 
T-space pixel amplitudes of said first output color 
data plane to produce a corresponding column of 55 
bandpass filtered T-space pixel amplitudes; 

means for bandpass filtering each pixel row of T- 
space pixel amplitudes of said first output color 
data plane to produce a corresponding row of 
bandpass filtered T-space pixel amplitudes; 60 

means for combining said bandpass filtered pixel rows 
and columns to produce two-dimensionally band- 
pass filtered T-space pixel amplitudes; 

means for paring said two-dimensionally bandpass 
filtered T-space amplitudes whereby to boost high 65 
spatial frequency components having lower ampli- 
tudes and suppress high spatial frequency compo- 
nents having higher amplitudes; and 



means for edge enhancing and of said means for display- 
ing. 

57. The apparatus of claim 56 wherein said cascaded 
modulation transfer function further corresponds to a 
human visual contrast sensitivity function. 

58. The apparatus of claim 57 further comprising 
means for producing said normalization array corre- 
sponding to said cascaded modulation transfer function, 
comprising: 

means for determining from the number of pixel rows 
and pixel columns in each of said transform blocks 
the number of cycles per pixel of each of said spa- 
tial frequency coefficients and means for associat- 
ing each coefficient with a value of a modulation 
transfer function of said edge enhancing means at a 
corresponding spatial frequency in cycles per pixel 
whereby to form an edge enhancement modulation 
transfer function array; 
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means for determining from pixel spacing corre- 59. The apparatus of claim 58 further comprising 
spending to said means for displaying the number means for reducing the bandwidth of said human visual 
of cycles per unit distance of each of said spatial contrast sensitivity function by a predetermined factor 
frequency coefficients and means for associating whenever said means for compressing compresses said 
each coefficient with a value of a modulation trans- 5 second or third input color data planes, 
fer function of said displaying means at a corre- 60. The apparatus of claim 59 wherein the spatial 
sponding spatial frequency in cycles per unit dis- patterns of the pixels of said three colors in said image 
tance whereby to form a display modulation trans- plane are different, whereby said means for determining 
fer function array; the number of cycles per unit distance of said spatial 
means for determining from a viewing distance corre- 10 frequency coefficients produce different normalization 
sponding to said displaying means the number of arrays depending upon which one of said first, second 
cycles per degree of visual scan of each of said or third input color data planes is being compressed, 
spatial frequency coefficients and means for asso- 61. The apparatus of claim 59 wherein said second 
ciating each coefficient with a value of a human and third input color data planes comprise red minus 
visual contrast sensitivity function at a correspond- 15 green and blue minus green color difference signals and 
ing spatial frequency in cycles per degree whereby wherein said predetermined factor is 2 for said second 
to form a human visual contrast sensitivity function input color data plane and 4 for said third input color 
array; data plane, 
means for cascading said arrays together whereby to 62. The apparatus of claim 54 wherein said means for 
form a cascaded array of plural elements compris- 20 back-transforming said decompressed spatial frequency 
ing said cascaded modulation transfer function; and coefficients performs an inverse discrete cosine trans- 
means for inversing the elements of said cascaded form, 
array. ***** 
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